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ESTIMATION AND COMPENSATION OF THE PULSE-SHAPE 
RESPONSE IN WIRELESS TERMINALS 

BACKGROUND OF THE INVENTION 
This present invention relates generally to digital wireless communication systems, and more 
5 specifically, to the estimation of pulse shaping filters and compensation of signal distortion caused 
by the pulse-shaping filters in a wireless communication system. 

Mobile wireless terminals, such as cellular telephones, use pulse-shaping filters to filter 
transmit and receive signals. A basic function of the transmit pulse-shaping filter is to limit the 
bandwidth of the transmitted signal, while the function of the receive pulse-shaping filter is to 
1 0 recover the transmitted signal by filtering out noise and interference. 

Knowledge of the response of the pulse-shaping filter can be used to improve the capacity 
and coverage in certain wireless systems. For example, knowledge of the transmit and receive pulse- 
shaping filters may be used to cancel interference arising from a co-channel base station by aiding 
channel estimation and tracking. Additionally, knowledge of the pulse-shaping filters may be used 
15 in a GSM (Global System for Mobile Communications) receiver to provide improved channel 
estimation for MLSE (maximum likelihood sequence estimation) equalization. 

Knowledge of the pulse-shaping filters is encompassed in the impulse response. An impulse 
response is a mathematical function that describes the output waveform that results when the input is 
excited by a unit impulse function. The impulse response of the cascade of all transmit and receive 
20 pulse-shaping filters in a communication system, or the pulse-shape response, can be used to 

describe the response characteristics of the pulse-shaping filters. In a communication system using 
partial response signaling (e.g., GSM), the over-all channel impulse response, which is used by 
demodulators in the wireless terminals to recover the intended signal, consists of the impulse 
response to the transmission medium (i.e., the medium response) convolved with the pulse-shape 
25 response. The over-all channel response for fractional equalization for a full-response signaling 

system (e.g., the D-AMPS system) can also be broken down into the medium response and the pulse- 
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shape response. Moreover, the channel response for a co-channel interferer not time-aligned with the 
desired signal, which is used for joint demodulation in an D-AMPS terminal, is also given by the 
convolution of the interfered medium response and the pulse-shape response. Estimating the 
medium response with knowledge of the pulse-shape response is superior to estimating the over-all 
channel response. This is applicable in all the above-mentioned examples. 

The pulse-shape response is largely fixed when the wireless terminal is manufactured. 
However, due to manufacturing and component variability, the pulse-shape response may not 
perfectly match the intended pulse-shape response. Additionally, an analog receive filter is 
susceptible to temperature variation and aging which may cause it to change in time. Distortion in 
the pulse-shape response may cause inter-symbol interference (ISI) and/or adjacent channel 
interference (ACI). Moreover, the disparity between the assumed and actual receive filters may lead 
to a performance loss in the above discussed techniques that rely on the pulse-shape response. 

BRIEF SUMMARY OF THE INVENTION 
In accordance with the invention as embodied and broadly described herein, the impulse 

response of a receive circuit in a wireless mobile terminal is estimated. 

One aspect of the present invention comprises receiving a wireless signal and filtering the 

signal with a receive filter. The impulse response of the receive filter is estimated based on the 

filtered signal and on an expected version of the signal. 

A second aspect of the present invention is related to a system comprising a receive filter, a 

sampler, and a pulse shape estimator. The receive filter is configured to filter an input signal 

corresponding to a received version of a plurality of training symbols. The pulse-shape estimator 

calculates an estimated impulse response of the receive filter based on the received signal and on an 

expected version of the plurality of training symbols. 
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BRIEF DESCRIPTION OF THE DRAWINGS 
The accompanying drawings, which are incorporated in and constitute a part of this 
specification, illustrate the invention and, together with the description, explain the invention. In the 
drawings, 

5 Fig. 1 is a block diagram illustrating a system for calculating the pulse-shape response in a 

receive circuit; 

Fig. 2 is a block diagram illustrating a system consistent with the present invention for 
calculating the pulse-shape response and the channel response in a receive circuit; and 

Fig. 3 is a block diagram illustrating a system for performing pulse-shape compensation. 

1 0 DETAILED DESCRIPTION OF THE INVENTION 

The following detailed description of the invention refers to the accompanying drawings. 
The same reference numbers in different drawings identify the same or similar elements. Also, the 
following detailed description does not limit the invention. Instead, the scope of the invention is 
defined by the appended claims and equivalents. 

1 5 Fig. 1 is a block diagram illustrating a system for estimating the pulse-shape response in a 

TDMA (time division multiple access) wireless mobile terminal. The system includes a number of 
elements connected in series, including: an antenna 102, a downconverter 104, a pulse-shape receive 
filter 106, a synchronizer 108, a sampler 109, a pulse-shape estimator 1 12, and an interpolator 1 14. 
Radio signals are received by antenna 102 and downconverted to a baseband signal by 

20 downconverter 104. The baseband signal then passes through pulse-shaped receive filter 106 and 
then through synchronizer 108, which determines the optimum sampling period for the signal. 

Information within time slots of a TDMA signal are transmitted in units of information called 
symbols. The symbols are transmitted at a predetermined symbol rate (illustrated as period T in Fig. 
1) . For example, in the IS136 standard, the symbol rate is 24.3 kilo-symbols per second. The signal 
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output from synchronizer 108 is sampled by sampler 109 at J times the symbol rate, where J is a 
positive integer, to generate a sampled received signal y(n), which has a period of J/T. 

Antenna 102, downconverter 104, pulse-shaping receive filter 106, synchronizer 108, and 
sampler 109 are all well known in the implementation of wireless mobile terminals. Accordingly, 
5 additional details relating to the construction of these components will not be given herein. 

Pulse-shaped estimator 112 estimates the impulse response (i.e., the pulse-shape response), 
labeled asP y in Fig. 1, of the cascade of the transmit filter and receive filter 106, based on the 
sampled received signal y(n). The pulse-shape response may be interpolated to have a higher 
effective sampling rate, labeled as signal P r hy optional interpolator 1 14. Pulse shaped estimator 
10 112 and interpolator 1 1 4 will be described in more detail below. 

During a pulse-shape estimation period by pulse-shape estimator 112, training symbols are 
received by antenna 102. The training symbols define a predetermined symbol pattern, and the 
sampled received signal y(n) thus corresponds to the received version of the training symbols. Pulse- 
shape estimator 112 stores a known version of the training symbols 113, which may be stored in a 
15 memory. In general, by comparing the sampled received signal y(n), which corresponds to the 

training symbols after transmission and processing by downconverter 104 and receive filter 106, to 
the expected pre-stored training symbols 113, pulse-shape estimator 112 estimates the pulse-shape 
response of the receive filter 106. The details of this comparison are given below with reference to 
equations (1) - (9). 

20 The sampled received signal for slot m, y m (n) may be modeled as: 


where g m is a flat faded medium response coefficient for slot m,p(i) is the pulse shape response of 
length M samples (M is assumed odd for illustration), and w m (n) is an additive noise process. The 
impairments of additive noise and fiat fading are well known in the art and are described, for 



(1) 
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example, in the book "Digital Communications," by J. G. Proakis, 2nd Ed., New York, McGraw- 
Hill, 1989. Additionally, 


0 


n = 0, J, 2 J,... 
otherwise 


(2) 


where a n are the known training symbols 113. 
5 The model of equation (1) can be rewritten in a vector format as 

y m = gm A P+™ m ( 3 ) 

where y m is the received signal vector for slot m of length (JN-M+1) samples, which correspond to N 
training symbols {a 0 , a h . . . , a N -i). The vectors y and w m may then be given by 


M + l 


the pulse-shape vector p may be given by 


and the (JN - M + 1) by M matrix A may be given by 


u JN-2 


(4) 


(5) 


(6) 


(V) 


15 From equation (3), the pulse-shape vector estimate for slot m p ^ may be derived using: 
P m =(A H AYA H y m , (8) 
where the superscript H stands for Hermitian transpose. The final pulse-shape estimate p may then 
be calculated by: 
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In operation, pulse- shape estimator 112 calculates an estimated pulse-shape response 
corresponding to filter 106 using equation (9), known training symbols 113 and the sampled received 
signal y obtained over the training period for a few slots (called K). 
5 The pulse-shape estimate;? is a vector that consists of a series of coefficients corresponding 

to the sampling rate J/T. It may, however, be desirable to obtain the pulse-shape coefficients at a 
sampling rate higher than J/T. If the baseband signal bandwidth, W, is less than J/2T, then 
interpolator 1 14 may interpolate p to obtain a signal with a higher sampling rate, J 7T. Interpolator 
1 14 may be implemented as a low-pass filter with a cut-off frequency between W and J/2T followed 
10 by a J7T-rate sampler. 

In the implementation described above, known training symbols 113 are stored in a memory 
in pulse-shape estimator 112. Alternatively, however, the training symbols 113 may be detected by a 
demodulator that receives the received sampled signals y(n). If training symbols are not available, 
data symbols may then be fed back to pulse-shape estimator 1 12 and used in lieu of training symbols 
15 113. 

The pulse-shape estimate which is calculated by the pulse-shape estimator 112 may be used 
in a number of different ways. At the factory, a test signal can be generated using an ideal (or 
accurate) pulse-shaping filter. The signal can be used by a mobile wireless terminal to calculate the 
combined response of the transmit filter and receive filter 106. Based on the calculated pulse-shape 
20 estimate p , the factory may adjust receive filter 106 directly or adjust the coefficients of a 

programmable digital FIR filter used in cascade with receive filter 106. Alternatively, pulse-shape 
estimator 1 12 may be used to periodically update pulse-shape estimate p during the life of the 
wireless terminal. The final pulse-shape estimate p may be obtained by maximum-ratio-combining 
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the faded pulse-shape estimates over several slots as in equation (9). The estimate can also be 
obtained by smoothing over multiple slots using a forgetting factor^ as 

L+u = A L,s ^Ln^W ' (10) 

where the subscript s denotes the smoothed estimate. 

5 Those skilled in the art will recognize that a certain amount of dispersion can be tolerated in 

the above calculation of p and the one given in equation (9), although a large amount of dispersion 
will deteriorate the pulse-shape estimate. 

Fig. 2 is a block diagram illustrating an alternate system for estimating the pulse-shape 
response and the channel response in a mobile terminal. This aspect of the present invention may be 

1 0 particularly useful for dispersive signals. 

The system illustrated in Fig. 2 includes a number of elements identical to those described in 
reference to the system described in reference to Fig. 1. In particular, antenna 102, downconverter 
104, filter 106, synchonizer 108, and sampler 109 are implemented as described above. 
Additionally, as shown in Fig. 2, the sampled received signal y(n) is received by pulse-shape 

15 estimator 212 and by optional downsampler 214, which may downsample the received signal before 
it is received by demodulator 216. Demodulator 216 demodulates the transmitted data symbols (i.e., 
the demodulator separates the data symbols from the carrier wave). Pulse- shape estimator 212 
estimates a J times over-sampled pulse-shape response, pj , which is received by a channel estimator 
218. The channel estimator 218 estimates the overall channel response, c , using the pulse-shape 

20 information provided by the pulse-shape estimator 212 and outputs the estimated channel response 
and the medium response £ . The channel response may be used by the demodulator 216 to enhance 

demodulation of the data symbols. 

The sampled received signal for slot m, y m (n) may be modeled as: 

yM= 'Z^OX-, (11) 

_ -M+\ 
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where c m (i) is the overall channel impulse response, which is a combination of the medium impulse 
response and the pulse shape response. More particularly, the overall channel impulse response may 
be calculated using 


■„(/)= t,PU)g m d-j), 


(12) 


5 where {g m (z) }* =1 1 } is the K-tap transmission medium response. The received signal samples for slot 
m, corresponding to N training symbols {a 0 , a h . . ., a N -j), may be arranged in a vector of size JN - 
M - K + 2 as follows 

y m =AG m p + w m , (13) 
where the vectors y and w m may be given by 


10 


CM, 


A represents an (JN-M-K+2) x (M+K-l) matrix of training symbols, given by 


*M+K-2 u M+K-3 
a M + K-l a M+K-2 


(15) 


(16) 


andG m represents a (M+K-l) x M matrix of medium response coefficients, given by 

0 


g m (0) 0 


0 


0 

'•• ^(0) 

0 g m (K-l\ 


(17) 
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Based on equation (13), the pulse-shape estimate p m+1 for slot m+1 may be obtained using the LMS 
(least mean squares) algorithm as 

L+rL + ( 18 > 

where flis the step size of the LMS algorithm, G m is a matrix of estimated medium response 
5 coefficients g m (i) for slot m provided by the channel estimator 212 and e m is the error signal for slot 
m, given by 

£m=y m -AG m p m . (19) 
The implementation of channel estimator 212 and its associated medium response 
coefficients g m (0 is well known in the art. One example of an appropriate channel estimator is given 
10 in U.S. Patent No. 5,838,739, titled "Channel Estimator Circuitry and Associated Method for a 
Digital Communication System." 

As described above with reference to Fig. 2, pulse-shape estimator 212 calculates the impulse 
response of receive filter 106 based on the received sampled signal y(n), the known training symbols 
213, and the medium response coefficients received from channel estimator 218. The calculated 
1 5 impulse response may be used by channel estimator 2 1 8 to calculate the overall channel response, 
which may then be used by demodulator 216 in demodulating the received symbols. By calculating 
the pulse-shape response at pulse-shape estimator 218, the overall channel response determined by 
channel estimator 218 can be more accurately determined, thus improving the effectiveness of 
demodulator 216. 

20 One of ordinary skill in the art will recognize that modifications can be made to the system 

shown in Fig. 2. For example, if training symbols 213 are not available, data symbols obtained from 
demodulator 216 can be input to pulse-shape estimator 212 and used in calculating the pulse-shape 
response. Further, algorithms other than the LMS algorithm may be used to minimize the error in 
the estimated pulse-shape response. Still further, the pulse-shape estimate may be updated only at 

25 certain times, such as when the channel conditions are favorable, as may be indicated by a CRC 
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(cyclic redundancy code) check. In the case of multiuser receivers, the training or data symbols of 
any subset of users (sharing a common pulse-shape) can be used. Moreover, received signal samples 
obtained at a timing offset from the correct signal timing can be used to obtain pulse-shape estimates 
for the particular timing offset. This may be useful for multiuser detection of asynchronous user 

5 signals, where the received signal is sampled at the timing of one user, while the symbols of another 
user are employed for pulse-shape estimation. 

The systems of Figs. 1 and 2 illustrate aspects of the present invention for estimating the 
combined response of the transmit and receive pulse-shape filters (pulse-shape response). In the 
system of Fig. 2, the calculated pulse-shape response coefficients are additionally used as side 

10 information in estimating and tracking the channel response. One skilled in the art will recognize 
that the present invention can also be used to estimate the response of the transmit pulse-shaping 
filters if the response of the receive pulse-shaping filters is known accurately, and vice versa. 

The pulse-shape response estimate can also be used to compensate for pulse-shape distortion 
due to manufacturing defects or other variations in analog receive filters. 

15 Fig. 3 is a block diagram illustrating such a system for performing pulse-shape compensation. 

The system illustrated in Fig. 3 includes a number of elements identical to those described in 
reference to the systems of Figs. 1 and 2. In particular, antenna 102, downconverter 104, filter 106, 
synchonizer 108, and sampler 109 may be implemented as described above. Additionally, pulse- 
shape estimator 112 calculates the impulse response of the receive filter 106 as described in 

20 reference to Fig. 1 . 

As is further shown in Fig. 3, compensation filter estimator 314 receives the calculated pulse- 
shape response p from pulse-shape estimator 112. Based on the pulse-shape response p , 
compensation filter estimator 314 calculates the coefficients for a digital FIR (finite impulse 
response) filter / , known as the compensation filter. The received sampled signal y(n) is filtered by 

25 compensation filter 316. The filtered signal may then be downsampled by downsampler 318 before 
passing to demodulator 320, which demodulates the transmitted symbols. 
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One implementation of compensation filter estimator 314 designs the filter to minimize the 
squared error between the target pulse shape response, p'(n) , and the compensated pulse-shape 
response. The squared error may be determined using 

^\p'(n)-f(n)*Kn)f (20) 

5 where p{n) is the M-tap estimated pulse-shape response from pulse-shape estimator 112 and "*" 
indicates the convolution operation. The compensation filter that minimizes the squared error is 
given by 

f = R~ l £ (21) 

where 

10 / = \f(zl^y.j^^j , for L odd , (22) 

q is an L x 1 vector with elements 

q(n) = f,P' (» + 0£*(0, n= 0.1... ., L-l (23) 

1=0 

and R represents an L x L Hermitian Toeplitz matrix with the elements of the first column given by 
/-(*) = j^(« + 0£*(0, n=0, 1,...,L-1. (24) 

15 Compensation filter 316 may be designed to zero-force ISI (inter-symbol interference) caused 

by pulse-shape distortion by selecting a given sampled Nyquist pulse-shape as the target response. 
The target response in the case of a symbol-rate pulse-shape response is an impulse function. 
Symbol-rate pulse-shape compensation eliminates ISI and also whitens the noise if the transmit filter 
is Nyquist (but the receive filter is not). However, symbol rate filtering does not yield a desired 

20 Nyquist pulse-shape p d (?) if the signal has excess bandwidth; it only forces the compensated pulse- 
shape response to be zero at symbol intervals except at the sampling time, 

i.e. p' (n) = p d (nT) = S{n). To obtain a desired Nyquist pulse-shape, the actual pulse-shape response 
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may be estimated for a sampling rate J/T greater than twice the signal bandwidth, while the 
compensation filter 3 14 operates at the same rate. For example, J=2 for square-root-raised-cosine 
filters with roll-off between 0% and 100%. In this case, the target response may be chosen 
as p'(n) = p d (nT IT). 

5 Those skilled in the art will note that pulse-shape response estimation and determination of 

the compensation filter could alternatively be implemented by a single component. Moreover, pulse- 
shape compensation filtering may be applied before synchronization. This may improve 
synchronization performance, albeit at the cost of additional processing. 

In systems that employ full-response signaling such as the D-AMPS system, pulse-shape 
10 distortion causes inter-symbol-interference and may also result in the enhancement of adjacent 

channel interference (ACI). This may lead to a high product failure rate at the factory, thus lowering 
yield. Pulse-shape compensation can be used to increase factory yield or to relax filter design 
constraints. The worst-case pulse-shape distortion may be such that it necessitates the use of an 
equalizer to handle ISI even for flat fading channels. Pulse-shape compensation can additionally be 
1 5 used to enable a conventional single-tap detector to be used with flat fading channels, thus allowing a 
performance gain as over-modeling of the signal is avoided. 

Aspects of the present invention, as described above, were described with reference to a 
mobile terminal. The term "mobile terminal" may include a cellular radiotelephone with or without 
a multi-line display; a Personal Communications System (PCS) terminal that may combine a cellular 
20 radiotelephone with data processing, facsimile and data communications capabilities; a PDA that 
can include a radiotelephone, a pager, Internet/intranet access, a Web browser, organizer, calendar 
and/or a global positioning system (GPS) receiver; and a conventional laptop and/or palmtop 
receiver or other appliance that includes a radiotelephone transceiver. Mobile terminals may also be 
referred to as "pervasive computing" devices. 
25 In addition, the present invention was described in the context of GSM and D-AMPS 

communication systems. While the present invention may be particularly useful for improving the 
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performance of GSM and D-AMPS networks, it should be understood that the principles of the 
present invention may be applied to any cellular or wireless system utilizing other air interfaces, such 
as CDMA or FDMA. It should be further understood that the principles of the present invention may 
be utilized in hybrid systems that are combinations of two or more of the above air interfaces. In 
5 addition, a mobile terminal, in accordance with the present invention, may be designed to 

communicate with a base station transceiver using any standard based on GSM, TDMA, CDMA, 
FDMA, a hybrid of such standards or any other standard. 

The present invention may be embodied as cellular communication systems, circuits, 
methods, and/or computer program products. Accordingly, the present invention may be embodied 

10 in hardware and/or in software (including firmware, resident software, micro-code, etc.). 

Furthermore, the present invention may take the form of a computer program product on a computer- 
usable or computer-readable storage medium having computer-usable or computer-readable program 
code embodied in the medium for use by or in connection with an instruction execution system. In 
the context of this document, a computer-usable or computer-readable medium may be any medium 

1 5 that can contain, store, communicate, propagate, or transport the program for use by or in connection 
with the instruction execution system, apparatus, or device. The computer-usable or computer- 
readable medium may be, for example, but not limited to: an electronic, magnetic, optical, 
electromagnetic, infrared, or semiconductor system, apparatus, device, or propagation medium. 
More specific examples (a nonexhaustive list) of the computer-readable medium would include the 

20 following: an electrical connection having one or more wires, a portable computer diskette, a random 
access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory 
(EPROM or Flash memory), an optical fiber, and a portable compact disc read-only memory (CD- 
ROM). Note that the computer-usable or computer-readable medium could even be paper or another 
suitable medium upon which the program is printed, as the program can be electronically captured, 

25 via, for instance, optical scanning of the paper or other medium, then compiled, interpreted, or 
otherwise processed in a suitable manner, if necessary, and then stored in a computer memory. 
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